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Biological and engineered systems operate by conpling function to the transfer of heat and/or 
particles down a thermal or chemical gradient. In idealized deterministically driven systems, ther¬ 
modynamic control can be exerted reversibly, with no entropy production, as long as the rate of 
the protocol is made slow compared to the eqnilibration time of the system. Here we consider fully 
realizable, entropically driven systems where the control parameters themselves obey rules that are 
reversible and that acquire directionality in time solely through dissipation. We show that when 
such a system moves in a directed way through thermodynamic space, it must produce entropy 
that is on average larger than its generalized displacement as measured by the Fisher information 
metric. This distance measure is sub-extensive but cannot be made small by slowing the rate of the 
protocol. 
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It is generally believed that the fundamental laws of 
physics preserve phase space volume and are almost the 
same in reverse [26) . However, the macroscopic world 
with which we interact is dominated by biological and en¬ 
gineered machines that are dissipative and which strongly 
break time reversibility; although their microscopic com¬ 
ponents obey the phase space volume preserving laws of 
physics, they couple movement to the production of en¬ 
tropy, leading them to move more often than not in a 
particular direction. An engine couples the movement 
of heat down a thermal gradient to mechanical motion, 
leading it to move forward more often than backwards. 
The macroscopic engines ubiquitous in engineered sys¬ 
tems are sufficiently large and dissipative as to rarely 
move in reverse. However, the processive but stochas¬ 
tic molecular motors common in biology do indeed take 
frequent steps backwards [IHSl, reminding us of the en- 
tropic and necessarily stochastic underpinnings of their 
directed motion. 

How much entropy must be produced to ensure that a 
thermodynamic system will, on average, move in a for¬ 
ward direction? Most previous analysis of this question 
has assumed that the system is driven through the ac¬ 
tion of some number of control parameters, A^, which 
couple to degrees of freedom, {x}, of a controlled system 
through a term in the Hamiltonian — A^$^({a;}), where 
$^({a;}) is the conjugate force to A^. As control param¬ 
eters are moved deterministically through some prede¬ 
termined protocol A(t), they do a stochastic amount of 
work on the system W = f dt^^^^{t) where stochastic- 
ity arises due to the probabilistic nature of $^(t) which 
depend implicitly on the system’s state, {a:}. For such 
deterministically driven systems, as the protocol is made 
infinitely slow, {W) —>■ AF’, and the protocol becomes 
dissipationless. The aim of this paper is to present a 
new bound that applies to fully realizable, entropically 
driven systems, where all components obey microscopic 
reversibility, acquiring directionality in time only through 


dissipation. We show that controlling such a system en¬ 
tails a finite entropic cost that cannot be removed by 
lengthening the time of the protocol. 

The last two decades have seen enormous progress 
on understanding deterministically driven systems, with 
surprising equalities applying to ensemble averages of en¬ 
tropy production [7] and statistical properties of micro¬ 
scopic trajectories [5]. In addition, new bounds constrain 
the entropy production associated with finite time pro¬ 
tocols. Using arguments from linear response, Sivak and 
Crooks [9] showed that any protocol starting at Aq and 
ending at A/, to be completed in time tmax must dissipate 
at least 
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entropy (in units where Boltzmann’s constant ks = I)- 
Here £(Ao,A/) is the geodesic distance between initial 
and final control parameters in the metric space where 
infinitesimal length dl between A and A -|- dA is given 
by dr = (A) dA^dA^, where here and throughout re¬ 

peated indeces are summed and ^ is a ‘friction tensor’ 
defined by 
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Crooks as well as Burbea and Rao [M E] considered 
dissipation in related protocols in which thermodynamic 
parameters are moved in N discrete steps, with the sys¬ 
tem coming fully to equilibrium between each step. In 
this case the dissipation is bounded by 
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where the tilde-free £(Ao, A/) is the geodesic distance be¬ 
tween initial and final control parameters in the metric 
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FIG. 1: A fully realizable system consisting of a controlled 
system of interest with Hamiltonian Hays, a series of particle 
reservoirs i each with chemical potential Xi/P, and an un¬ 
specified source of bias entropy 55bias. At a fast timescale the 
system exchanges particles with bath i, and at a much slower 
timescale it hops from bath i to i ± 1, producing ±5Sbias 
entropy. When SShins is small, the system tends to drift, hop¬ 
ping both forwards and backwards, during which it moves 
particles down their chemical gradient, dissipating additional 
entropy. As argued in the text, average forward movement 
requires a minimum entropy production that cannot be re¬ 
moved either by making dX = Ai+i — Xi or SShins small. 

space defined by the Fisher information matrix (FIM). 
The FIM measures statistical distinguishability between 
nearby models [niiig and in this parameterization takes 
the form 

g,. (A) = (4) 

In each of these deterministically driven cases, the en¬ 
tropy production can be reduced to an arbitrarily small 
value by taking the limit where either tmax —>■ oo or 
^steps —t oo. In this manuscript, we will consider fully 
realizable systems, where the control parameters them¬ 
selves obey dynamics that are in accord with the prin¬ 
ciples of time reversal invariance, moving forward more 
often than backwards only due to the increased volume of 
phase space associated with movement in that direction. 
In this entropically driven limit, there is an intrinsic cost 
associated with thermodynamic control, which, even as 
the procedure is made arbitrarily slow and fine-grained 
remains bounded by 

(A5tot) >2 /:(Ao,A/) (5) 

where C is the geodesic distance in the same metric space 
of the FIM defined in Eq. Demonstrating this bound 
and discussing its implications are the subject of this 
paper. 

Before looking at the more general case, consider a sys¬ 
tem with just a single control parameter. A, the chemical 


potential of particles interacting through some Hamil¬ 
tonian Hsys{{x}), where {cc} denotes the micro-state of 
the system (see Fig. [^. Particle number, 7V({x}) is a 
function of {x} and at time t the system may exchange 
particles with particle reservoir i{t) at chemical poten¬ 
tial Xijfi. After reaching equilibrium with bath i, the 
probability of finding the controlled system in state {a;} 
is given by an appropriate Boltzmann distribution, 

p. ^ exp {-/3H^yfi{x}) + XjN ({x})) 

Zi 

With these definitions, il = —log{Zi)/fi is the grand 
potential, and the Helmholtz free energy is given by 
Fsys,t = Xi{N)J/3, where (A)- = dlog{Z^)/dX. 

The FIM of this system can be expressed as (see Eq. 
g = . — (fV)^ = where the subscripts 

on g are omitted as the system contains only a single pa¬ 
rameter. Changes in the Helmholtz free energy describe 
changes in the entropy of the system and its coupled heat 
bath. Additionally, in a process in which ANi particles 
flow from the various particle reservoirs into the system, 
each particle reservoir’s entropy changes by an amount 
AS, = KAN,. 

In addition to dynamics in which the system comes to 
equilibrium with bath i, our system may also disconnect 
from bath i and reconnect to baths i -\- 1 or I — 1, that 
are held at Ai±i = Ai ± dX. Let us first consider dy¬ 
namics in which these steps happen in the forward and 
reverse directions with equal rates. In this directionless 
steady state, the complete system consisting of baths and 
controlled system is not in thermal equilibrium. In fact, 
as it diffuses back and forth, the controlled system will 
tend to move particles down their concentration gradi¬ 
ents. Consider a sequence in which the system starts 
in equilibrium connected to reservoir i, hops to reservoir 
i-\-l, comes to equilibrium there, and then hops back to 
reservoir i where it again comes to equilibrium. At the 
end of this sequence, the entropy of the thermal bath and 
controlled system remain unchanged. However, on aver¬ 
age, particles have been transferred from bath i -|- I to 
bath i] during the forward hop the system carries, on av¬ 
erage (A^)j particles while in the backwards trajectory it 
carries {N)._^_.^^={N)--\-gdX-\-0{dX)^ particles (see Eq.|^. 

In fact a hop in either direction produces, on aver¬ 
age, total entropy g{dX)^ /2. Consider a sequence in 
which the systems hops from bath i to bath * ± I, 
where it comes to equilibrium. The Helmholtz free en¬ 
ergy of the system changes by fiAF^ys = AgXidX + 

(§ + ^ ^d \^' ) + 0{dXY. The entropy of reser¬ 

voir i±l also changes. On average, (A^)j_|_i — par¬ 
ticles flow out of it, changing its entropy by ASi±i = 
{X, ± dXi){±gdX + ^^^^(dA)2 -k 0{dX)^). Thus the 
system-kbath-kreservoir entropy, 5'sys-i- = 
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increases, on average, by 

= |(dA)2 + 0(dA)3. (7) 

So far this system has no well defined direction of op¬ 
eration, despite its dissipative nature. To bias towards 
movement in the forward direction, a step from one par¬ 
ticle reservoir to the next may couple to the dissipation 
of an unspecified source of biasing entropy SShias, so that 
a step from i —>■ *-|-l is more likely than one in the reverse 
direction, with the forward and reverse rates r±, as well 
as the average number of forward and reverse hops, n± 
related by BM- 

(n_) = (n+) X exp(-( 5 S'bias)- ( 8 ) 


Microscopically, SSuas could arise from many sources. 
For example, forward movement might be accompanied 
by the transfer of a fixed amount of energy down a ther¬ 
mal gradient, or of particles down a chemical gradient. 
It is important to note that the reverse step does indeed 
reduce the entropy of the world by SShms- 

Let us now consider the average dissipation associ¬ 
ated with moving system parameters from Aq to A/, 
over a trajectory through which g is constant so that 
C (Aq, Ay) = Y^|Ay — Aq]. The total average dissipation 
associated with this trajectory is given by the sum of 
bias related dissipations and dissipations associated with 
hops, AS'sys+: 

(AS'tot) = {n+ - n_) (jS'bias + {n+ + ri-) (AS'sys+) (9) 


In any trajectory which moves from Aq to Ay, n_|_ —n_ = 
(Ay — Aq) /dX. Combining with Eqs. and the total 
average dissipation is given by 


(A^tot) =/:(Ao,Ay) 


I ^-^bias 
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An idealized system could have any stepsize dX and any 
(^iSbias- Optimizing over these to find the values that 
minimize the dissipation we find that 


5(dA°^‘)^ ={6SXf 




( 11 ) 


(A^°P‘) =2/:(Ao,Ay), 

demonstrating Eq. [^for this system. 

To achieve the bound, the system must be in the con¬ 
tinuum limit where dX and (jS'bias are small. Further¬ 
more, if i55'bias > y/gdX then entropy is produced primar¬ 
ily in breaking the time-reversal-invariance of the control 
parameters, though the work done on the system can be 
made arbitrarily close to the change in free energy. On 
the other hand, if SShias < ^/gdX then most entropy is 


produced in futile cycles in which the system moves back 
and forth in A space. Insight into the optimum param¬ 
eters can be gained by considering the ‘proper’ velocity 
and diffusion coefficient where proper distance is mea¬ 
sured by the FIM (where for generality we have added 
back indeces on g) : 


V 

D 


3(Am) d{\-) 

at at 


1 

2 ^“^ at 


( 12 ) 


where square brackets denote a second cumulant. It is 
important to note that these each have dimensions of 
inverse time since proper distance as measured by the 
FIM is dimensionless. For this system, in the continuum 
limit, V = ^/gr^dXSShias while D — gr^{dX)^. As such, 
the optimum occurs when D = V. 

These results also hold for a generalized system with 
multiple control parameters A^, which could be baths of 
different particles, temperature, displacements or other 
quantities conjugate to a generalized force. Taking a 
continuum trajectory, we assume that the controlled sys¬ 
tem will be moved through a one-dimensional track A(r), 
with motion along the track consisting of (one dimen¬ 
sional) diffusion and drift, microscopically arising from 
dynamics analogous to those considered in the one di¬ 
mensional example. At a pa rtic ular point A(r), using 

the dehnitions provided in Eq. ^ 


V = 


dt 


dX^ dX^ 

dr dr 


and D = \ 


dV 


Similar analysis shows 
that in this multi-parameter continuum system, entropy 
is produced at the following rate: 


^('S'syg-|- ) 


dt 


= D 


= V'^/D 


(13) 


The average amount of time it takes to traverse a seg¬ 
ment of length dr is given by (dt) = g^^ ^^dTjV, 
so that the dissipation associated with movement 
along a segment of length dr is given by (dStot) = 

{DjV + V/D) This is minimized when 

jjopt _ yopt gp the minimum average dissipation as¬ 
sociated with a stochastic protocol that on average moves 
from Aq to A/ along path A(t) is given by 

(14) 

> 2£ ^Aq, A/^ . 

Note that the first equality defines (twice) the path 
length. Thus, the inequality below follows from the 
definition of C as the length of the minimum length 
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(geodesic) path. Equality is achieved only when A(t) 
is the minimum length geodesic connecting Aq with A/. 

It is interesting to compare the bound presented here 
with those found by Crooks and Sivak (Eqs. and and 
Refs. [HI dO])- Each of these previous bounds roughly 
correspond to limits in which ^iSbias is infinite, leading to 
a deterministic protocol, but where the process leading 
to that bias is ignored as a source of dissipation. Each of 
these previous bounds can be made small by lengthening 
the time or number of steps associated with a protocol. 
By contrast, neither the time, nor the number of steps 
enter the bound presented here. 

The bounds presented by Crooks and Sivak laiiQ] also 
scale differently with system size. Both the FIM dehned 
in Eq. and the metric introduced in Ref. [H] and Eq. 
are extensive, scaling linearly with system size in the 
thermodynamic limit. However, geodesic lengths scale 
as the square root of the metric. As the geodesic lengths 
are squared in Eqs. and these bounds are extensive 
in the precise sense that controlling two identical and 
uncorrelated systems in tandem requires twice the dis¬ 
sipation. By contrast, the bound presented here scales 
as the square-root of the system size; two identical sys¬ 
tems limited by this bound could be controlled in tandem 
with only as much dissipation. Thus, this bound be¬ 
comes less important in the thermodynamic limit - it is 
more likely to be relevant for molecular machines than for 
large engineered systems, where extensive though finite 
time bounds [9] are more likely to be relevant. 

The bound presented here is not in contradiction 
with the impressive array of experiments verifying the 
Jarzynski equality and Crooks relations. In these ex¬ 
perimental tests, a control parameter is typically ma¬ 
nipulated in the nearly deterministic regime. For ex¬ 
ample, a bead attached to DNA or RNA is manipu¬ 
lated according to a predetermined force protocol by a 
laser operating as an optical tweezer. The work done 
by the bead on the nucleotide polymer has been shown 
to obey both the Jarzynski equality m and Crooks re¬ 
lations [T5]. It would seem that, as a corollary, these 
experiments verify the dissipationless adiabatic limit for 
quasi-deterministically driven systems. However, in these 
experimental paradigms the relatively enormous dissipa¬ 
tion associated with the laser itself is ignored. In the 
framework of this paper, this limit corresponds to the 
case where JS'bias is very large, but where its contribu¬ 
tion is ignored. 

It remains to be seen whether this bound meaning¬ 
fully constrains the operation of real biological systems. 
Biology often utilizes molecular scale motors for which 
sub-extensive contributions to energy expenditure could 
be relevant. In muscle fibers, contraction is initiated by 
the binding of calcium to myosin, which then hydrolyze 
ATP to perform mechanical work. Calcium binding acts 
much as SSbias does here, and biology spends substan¬ 
tial energy maintaining a low intracellular calcium con¬ 


centration in resting cells. As would be required to 
approach this bound, many biological motors are able 
to work in reverse, synthesizing ATP when pulled too 
hard m However, muscles do not seem to take ad¬ 
vantage of this property, hydrolyzing ATP during both 
extension and contraction under load, and operating far 
from the reversible regime m- Indeed, in many con¬ 
texts other considerations like speed, reliability and the 
constraints of chemistry m may matter more than en¬ 
ergetic efficiency. England recently used non-equilibrium 
arguments to estimate the energetic cost of cellular repli¬ 
cation, arguing that the dissipation required to rapidly 
build stable molecules dominates a bacterium’s energy 
budget [20]. Intriguingly, biological systems do seem to 
seek out highly cooperative, nearly-critical states [U] , in 
particular in their cell membrane |22] . These regions of 
thermodynamic space have, among other properties, a 
high negative Ricci curvature [12], implying ‘closeness’ 
to a much larger proper volume of distinct membrane 
compositions and corresponding physical properties. 

Further work will shed light on the extent to which this, 
or analogous bounds, apply to a larger class of fully re¬ 
alizable systems that do not contain any unphysical, de¬ 
terministic, elements. This bound would seem to apply 
to idealized logically reversible computing schemes [23] 
that have been used to argue against [ 23 ] an intrinsic 
energetic cost associated with the mechanical manipu¬ 
lations underlying computation [23]. In addition this 
bound constrains the efficiency of finite size heat engines. 
A Carnot cycle operating between temperatures Th and 
Tc with pressures P 2 and Pi bounding the high tempera¬ 
ture portion would have to dissipate entropy greater than 
A^tot > 4A/]Vlog(P2/Hi) + 4Vl5A/log(T/j/rc) in every 
cycle. Note the '/N dependence of this dissipation- in the 
adiabatic limit an idealized deterministic system would 
be dissipationless, producing no net entropy but transfer¬ 
ring an extensive Qh = NTh \og{P 2 /Pi) heat out of a hot 
bath and performing W = N(Th — Tc) log{P 2 /Pi) work. 
For fully realizable systems, any directed change must 
be driven by a finite, though sub-extensive, production 
of entropy, even if change is made slowly. 
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